Read metadata file

There are annotations available for the movement of 5 hands. The annotations that are to be displayed in the graphs and video below will have to be provided as keywords to the functions. Below are a list of the possible keywords:

  1. 'Tap_S': Hand taps of the singer
  2. 'Tap_H': Hand taps of the harmonium player
  3. 'Tan_S': Hand with tanpura of the singer
  4. 'Tan_L': Hand with tanpura of the person to the left of the singer (from viewer's perspective
  5. 'Tan_R': Hand with tanpura of the person to the right of the singer (from viewer's perspective

Play the video being analysed

Listen to the source-separated vocal audio:

The audio from this file has been processed to isolate the vocals. This was done using Spleeter: 4 stems model (https://github.com/deezer/spleeter). This audio will be used for pitch tracking (done below)

Initialise and populate the figure

Create audio with clicks and video with squares

We create a temporary folder to store the edited audios and videos

Play the video

The edited video is stored in the 'Temp' folder under the name 'finalVid.mp4'

Delete the temporary folder along with the contents that were created in it. The following line can be commented out if you wish to keep the temp folder.